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METHOD AND APPARATUS FOR ing steps: generating one or more transforms from the digital 

EMBEDDING DIGITAL INFORMATION IN multimedia data or a portion of the digital multimedia data, 

DIGITAL MULTIMEDIA DATA wherein said transforms are dependent on the digital mul- 
timedia data or the portion of the digital multimedia data; 

S generating transformed digital multimedia data by applying 

FIELD OF INVENTION the one or rnore transforms to the digital multimedia data or 

the portion of the digital multimedia data; embedding the 

The present invention relates to a method and apparatus digital information in the transformed digital multimedia 

for embedding digital information in digital multimedia data; and generating the digital multimedia data embedded 

data. The invention also relates to a computer program with the digital information by applying one or more inverse 

product including a computer readable medium having transforms of the one or more transforms to the embedded 

recorded thereon a computer program for embedding digital transformed digital multimedia data, 

information in digital multimedia data. A . . CtU . ♦ • *l • 

6 According to still another aspect of the invention, there is 

BACKGROUND OF INVENTION provided a method of embedding digital information in 

1S digital multimedia data, wherein said method includes the 

Over recent decades there has been a rapid growth in following steps: generating one or more transforms from the 

computers and digital communications networks With this di Ual multimcdia data or a portion of me digital multimedia 

growth, the illegal distribution duplication and the manipu- d whefem sai(J transforms are dep endent on the digital 

latum of digital or digitised multimedia content have multimedia data or the ortioD of lhe digital mull i media 

become more and more common place. Even though such generating transformed digital multimedia data by 

activity may violate copyright laws, it is still widespread. 20 » & * *> 

There is thus a need to protect the rights of owners who own W^"* lhe ° ne or more *f f™ s l ° he d 'f al °? ul, ' m , e - 

these original multimedia data. dia u d J a ' a or J he P° rtI ° n . ° f the M il ™ ltimedia data ; 

_. ., . . . . ... c l. embedding the digital information in the one or more 

Sinularly, there has also been a proliferation of exchange transforms b Qr ^ inv and atj lhe ^ 

of sensmve data over public communions netwo rks. muMmedia data embedded w ; lh ^ 8 dighal ^aUon by 

Recently, digital signatures have been used to verify and 25 . , , , . r 1 

authenticate the integrity of such data and identity the sender a PP l y in S onc ° r m ° rc embedded inverse transforms to the 

of the data. However there exists a need for invisible digital transformed digital multimedia data, 

signature for images, which adequately represents the con- According to still another aspect of the invention, there is 

tent of the images and further can be used for verifying provided a method of embedding digital information in a 

whether the signed images have been modified. 30 digital image, wherein said method includes the following 

In addition, there has been an associated growth in steps: partitioning the image into blocks of pixels; clustering 

multimedia databases. Usually the stored multimedia data the partitioned blocks into classes according to a homoge- 

needs to be annotated (captioning). If the annotation can be neity criteria; selecting one or more of the clusters in 

associated with the content permanently, it will be conve- accordance with HVS analysis; generating an associated 

nient and safe for some applications such as medical image 35 Karhunen-Loevc (K-L) transform for each selected cluster, 

database. wherein the image blocks of each selected cluster are used 

Digital watermarking techniques can be applied to the as a vector population for the purposes of generating the 

above-mentioned applications, namely, for copyright associated K-L transform; applying the associated K-L 

protection, multimedia content authentication and multime- transform to the image blocks of the selected cluster to 

dia content annotation. Although visible watermarks have 40 produce corresponding transformed image blocks; 

been previously used, there is much promise for invisible embedding, for each selected cluster, the digital information 

digital watermarking techniques due to its unobtrusive i n the associated K-L transform; and applying, for each 

nature. Regardless of particular applications, the following selected cluster, an inverse transform of the embedded 

are the basic and common requirements for invisible water- associated K-L transform to the transformed image blocks of 

marks. The watermark should be unobtrusive and not annoy- ^ me seized cluster 

ing to bona-fide users. T^e watermark scheme should be According t0 stiU another aspect of the invention, there is 

robust to some reasonable distortions during storage and ed ^ ^ information in a 

transmission (such as compression, noise addition, format u • a ,u a • 1 a „ r~n~^~ 

conversion, and bit errors) The watermark scheme should d ^ ltal ™J&> whe ' em said m f th ° d mcludes * e M^rnS 

also be robust to some artifacts caused by signal processing s ^ s: Partitioning the image into blocks of pixels; clustering 

operations (such as noise reduction, filtering, sharpening, 50 the partitioned blocks into classes according to a homoge- 

and colour & intensity variations) It should also be secure neit y cntena ; selecting one or more of the clusters m 

against typical attacks such as colluding pirates who com- accordance with HVS analysis; generating an associated 

bine multiple versions of the same multimedia content that Karhunen-Loeve (K-L) transform for each selected cluster, 

are stamped with different watermarks. Erasing the water- wherein the image blocks of each selected cluster are used 

mark or replacing the watermark by another watermark ss as a vector population for the purposes of generating the 

should be technically difficult. associated K-L transform; applying the associated K-L 

Although these requirements are essential to practical transform to the image blocks of the selected cluster to 

applications, so far no one method or system is capable of produce corresponding transformed image blocks; 

fully satisfying the above conditions due to its so many embedding, for each selected cluster, the digital information 

unsolved problems and challenges. 60 in the selected transformed image blocks; applying, for each 

selected cluster, an inverse transform of the associated K-L 

ASPECTS OF INVENTION transform to the embedded transform image blocks of the 

It is an object of the present invention to ameliorate one selected cluster, 

or more disadvantages of the prior art. According to still another aspect of the invenuon, there is 

According to one aspect of the invention, there is pro- 65 provided a me mod of embedding digital information in a 

vided a method of embedding digital information in digital digital image, wherein said method includes the following 

multimedia data, wherein said method includes the follow- steps: partitioning the image into blocks of pixels; clustering 
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the partitioned blocks into classes according to a homoge- video images including a plurality of frames, wherein said 
neity criteria; selecting one or more of the clusters in method includes the following steps: extracting one or more 
accordance with HVS analysis; generating an associated key frames from the video images; generating one or more 
Karhuoen-Loeve (K-L) transform for each selected cluster, transforms from the key frames or a part thereof, wherein 
wherein the image blocks of each selected cluster are used 5 said transforms are dependent on the key frames or the part 
as a vector population for the purposes of generating the thereof; generating transformed key frames or part thereof 
associated K-L transform; applying the associated K-L by applying the one or more transforms to the key frames or 
transform to the image blocks of the selected cluster to the part thereof; embedding the digital information in the 
produce corresponding transformed image blocks; selecting, one or more transforms or their inverses; and generating the 
for each selected cluster, cither the associated K-L transform 1Q key frames or part thereof embedded with the digital infor- 
or its corresponding transformed image blocks for embed- mation by applying one or more embedded inverse trans- 
ding; embedding, for each selected cluster, the digital infer- forms to the transformed key frames or part thereof, 
mation in the selected K-L transform or the selected trans- According to still another aspect of the invention, there is 
formed image blocks; applying, for those selected clusters in provided a method of registering an image, wherein the 
which the digital information has been embedded in the 35 method includes the following steps: extracting key points 
associated K-L transform, an inverse transform of the from the image and their invariant attributes; extracting 
embedded associated K-L transform to the transformed other global information from the image; aligning the 
image blocks of the selected cluster; and applying, for those extracted key points and their invariant attributes with the 
selected clusters in which the digital information has been global information; and encrypting the aligned information 
embedded in the transformed image blocks, an inverse 2Q to provide an image signature. 

transform of the associated K-L transform to the embedded According to still another aspect of the invention, there is 

transform image blocks of the selected cluster. provided a method of modifying a first image in accordance 

According to still another aspect of the invention, there is with an image signature, wherein the image signature 

provided a method of embedding digital information in a includes encrypted key points of a second image and their 

plurality of images, wherein the images are stored and 25 invariant attributes and other aligned global information of 

classified into one or more classes and said method includes the second image and the method includes the steps of: 

the following steps: generating one or more transforms from decrypting the image signature to obtain the key points and 

the images of said respective one or more classes, wherein their invariant attributes and other global information of the 

said transforms are dependent on the images; generating second image; extracting key points and their invariant 

transformed images by applying the one or more transforms 30 attributes from the first image; extracting other global infor- 

to the images of said respective one or more classes; mation from the first image; matching the key points and 

embedding the digital information in the transformed their invariant attributes and other global information of the 

images; and generating the images data embedded with the first and second images; and normalising the first image 

digital information by applying one or more inverse trans- based on said matched key points and their invariant 

forms of the one or more transforms to the embedded 35 attributes and other global information, 

transformed images. According to still another aspect of the invention, there is 

According to still another aspect of the invention, there is provided a method of extracting digital information from 

provided a method of embedding digital information in a first digital multimedia data having embedded therein said 

plurality of images, wherein the images are stored and digital information, wherein said method includes the fol- 

classified into one or more classes and said method includes 4 q lowing steps: deriving one or more embedded transforms 

the following steps: generating one or more transforms from from a reference file, wherein said embedded transforms are 

the images of said respective one or more classes, wherein dependent on second digital multimedia data or a portion 

said transforms are dependent on the images; generating thereof; deriving transformed digital multimedia data from 

transformed images by applying the one or more transforms the reference file, wherein said transformed digital raulti- 

to the images of said respective one or more classes; 45 media data is dependent on the second digital multimedia 

embedding the digital information in the one or more data or a portion thereof; generating transformed digital 

transforms or their inverses; and generating the images multimedia data by applying one or more of the derived 

embedded with the digital information by applying one or embedded transforms to the first digital multimedia data or 

more embedded inverse transforms to the transformed a portion thereof; and correlating the generated transformed 

images. 50 digital multimedia with the derived transformed digital 

According to still another aspect of the invention, there is multimedia to check whether the digital information embed- 

provided a method of embedding digital information into ded in the first multimedia data is the same as that derived 

video images including a plurality of frames, wherein said from the reference file. 

method includes the following steps: extracting one or more According to still another aspect of the invention, there is 

key frames from the video images; generating one or more 55 provided a method of extracting digital information from 

transforms from the key frames or a part thereof, wherein first digital multimedia data having embedded therein said 

said transforms are dependent on the key frames or the part digital information, wherein said method includes the fol- 

thereof; generating transformed key frames or part thereof lowing steps: deriving one or more transforms from a 

by applying the one or more transforms to the key frames or reference file, wherein said transforms are dependent on 

the part thereof; embedding the digital information in the 60 second digital multimedia data or a portion thereof; deriving 

transformed key frames or part thereof; and generating the transformed digital multimedia data from the reference file, 

key frames or part thereof embedded with the digital infor- wherein said transformed digital multimedia data is depen- 

mation by applying one or more inverse transforms of the dent on the second digital multimedia data or a portion 

one or more transforms to the embedded key frames or part thereof; generating embedded transformed digital multime- 

thereof. 65 dia data by applying one or more of the derived embedded 

According to still another aspect of the invention, there is transforms to the first digital multimedia data or a portion 

provided a method of embedding digital information into thereof; and correlating the generated embedded trans- 
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formed digital multimedia with the derived transformed digital message within digital multimedia content. However, 

digital multimedia so as to extract the digital information. for ease of explanation, the steps of the preferred method are 

According to still another aspect of the invention, there is described with reference to a method of embedding a 

provided a method of embedding digital information in a watermark within a still digital image. Though, it is not 

digital image, wherein said method includes the following s intended that the present invention be limited to the latter 

steps: partitioning the image into blocks of pixels; clustering method. For example, the invention may have application to 

the partitioned blocks into classes according to a homoge- embedding an identification message within other multime- 

neity criteria; selecting one or more of the clusters in dia content such as video, audio, print or film. The embedded 

accordance with HVS analysis; averaging, for each selected identification message can also be used for copyright 

cluster, the blocks of pixels; embedding, for each selected 10 protection, content authentication and content annotation 

cluster, the digital information in the averaged blocks; and without departing from the scope and spirit of the invention, 
replacing, for each selected cluster, the blocks with the 

embedded averaged block for that cluster. Firsl Preferred Embodiments) 

According to still another aspect of the invention, there is FIG. 1 is a flow diagram of a method of embedding a 
provided a method of extracting digital information from an 15 watermark in a digital image according to a preferred 
image having embedded therein said digital information, embodiment. The method commences at step 100 and any 
wherein said method includes; partitioning the image into necessary initialisation processes are undertaken. In the next 
blocks of pixels; clustering the partitioned blocks into step 102, an original digital image is input by a user for 
classes according to a homogeneity criteria; selecting one or processing. The original digital image is a pixel-map rep- 
more of the clusters in accordance with information obtained 20 resentation which includes a numerical representation of the 
from a reference file; retrieving, for each selected cluster, an particular colour for each pixel location in a rectangular 
average block of pixels stored in the reference file; array . Any numerical representation of colour can be used 
averaging, for each selected cluster, the blocks of pixels of and can be expressed as a sequence of one or more numbers, 
the image; and correlating, for each selected pixel, the Also, other information may be input at this stage, such as 
averaged blocks of the image with the retrieved blocks to 25 header information. Such header information can include the 
determine whether a watermark exists. s i ze 0 f the image, resolution etc. 

According to still another aspect of the invention, there is The input original image is then preprocessed in step 104. 

provided an apparatus for implementing any one of the The preprocessing may take the form of filtering, noise 

aforementioned methods. 3Q estimation and so on. After the preprocessing step 104, the 

According to still another aspect of the invention there is method continues with a block and clustering step 106. 

provided a computer program product including a computer [ n me block and clustering step 106, the selected original 

readable medium having recorded thereon a computer pro- j mage ^ divided into N non-overlapping blocks of size nxn. 

gram for implementing any one of the methods described Preferably, these blocks are either 4x4 pixels or 8x8 pixels 

above. 35 in size. In the event the original image is not a multiple of 

BRIEF DESCRIPTION OF THE DRAWINGS the ima S e bIock size > a portion of the original image which 

_ . r.. • i •. i • < <• is a multiple can be used by the method and the remaining 

Embodiments of the invention are described with refer- portion disregarded< The block ^ cluster step 106 allocates 

ence to the drawings, in which: (he&e image blocks to clustefS (sometimes known as classes) 

FIG. 1 is a flow diagram of a method of embedding a 4Q accor di n g to the details of the image block content and a 

watermark in a digital image in accordance with a preferred homogeneity criteria. Thus the image blocks within each 

embodiment; cluster will have similar amount of and type of content. 

FIG. 2 shows a copyright protection system for protecting Preferably, the clusters are classified according to their 

an owner's watermarked image in accordance with a pre- complexity or texture content. This classification is achieved 

ferred embodiment; 45 m th e following manner. Firstly, feature measures are 

FIG. 3 is a flow diagram of a method of generating a extracted from each image block which are representative of 

reference file that can be used for both image registration the complexity of the content. Some preferred feature mea- 

and for image authentication in accordance with a preferred sures are grey scale, colour variation or texture measures, 

embodiment; Afterwards, the clustering process classifies the image 

FIG. 4 is a flow diagram of a method of extracting a 50 blocks according to their feature measures. The clustering 

watermark from an image in accordance with a preferred process preferably utilises the k-means clustering method, 

embodiment. Alternatively, the preferred method can use region growing, 

FIG. 5 shows a flow diagram of a method of registering or split-merge clustering processes. In this way, the block 

and recovering an image for use in the extraction method and clustering step allocates the image blocks to a plurality 

shown in FIG. 4; 5S of clusters. After the block and clustering step 106 is 

FIG. 6 is a flow diagram of a method of embedding a completed, the processing continues at step 108. 

watermark in a digital image according to a second preferred In step 108, a cluster selection process is undertaken. In 

embodiment; this selection process, an analysis based on the Human 

FIG. 7 there is shown a watermark extracting method for Vision System (HVS) is applied to all clusters to determine 

extracting a watermark embedded in accordance with the 60 whether and by how much the watermark can be embedded, 

method of FIG. 6; and Preferably, those clusters which satisfy the HVS require - 

FIG. 8 is a block diagram of a general-purpose computer ments are selected for watermark embedding. The percep- 

for implementing the preferred methods of FIGS. 1 to 7. tuaJ redundancies inherent in a still image are basically due 

to inconsistency in the sensitivity of the HVS to stimuli of 

DETAILED DESCRIPTION 65 var yj ng levels of contrast and luminance changes in the 

The principles of the preferred method described herein spatial domain. Thus, by utilising the HVS model in the 

have general applicability to a method of embedding a preferred method it is possible to embed more information 
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while not overall affecting image quality. Or in other words, Where c ik is the kth eigenvector (k=l, K, p)of the ith cluster 

the embedded watermark information is invisible to human and \ k is its corresponding eigenvalue. The eigenvectors 

eyes. In the preferred method, the HVS model is used to calculated from (2) are orthonormal, ie., 
select the clusters and the embedding strength. For example, 

the embedding strength is determined as a proportion of the 5 



«ifc r e«-0 (3) 



contrast of the image content of the cluster. Preferably, the (4) 
HVS model used is that described in the paper "A percep- 

tuaUy tuned subband image coder based on the measure of f*^*"^' the ?TT*? a u , <a 

Just-Noticeable-Distortion profile" by C. H. Chou aid Y. C. X " ">"*7 V , ' eig ' nVet f ? whMe A ' -.r' 

T . „ _ . . j c * c w'j 10 can be used to form the transform matrix AHe.-, c„ A J , 

Li, IEEE Trans. On c.rcu. s and Systems for V.deo ^ d . & ^ dimension Qf ^ p^ fe L r ^ ly 'l 0W ^ r> 

Technology, Vol. 5, No. 6, pp467-476 1995 (herein mcor- ^ ^ ei tors are used t0 form ' the transform matrix> 

porated by reference). In another embodiment, if there are a yiz L; . d ^ reason for the , atter - u , hat ^ preferred 

number of clusters which satisfy these HVS requirements, metbod is primarily coa^d wit h watermarking and not 

then one or more clusters can be selected by the user for 15 compress i on . Each vector X, y from the ith image cluster can 

embedding. Alternatively, different clusters can be embed- men De processed by the linear transform: 

ded with different watermarks with the same seeds to 

increase the security and robustness of the watermarking. Yf*pcjmi&M, (5) 

After the clusters have selected the preferred method pro- Aftef step m , he preferred method proceeds t0 ^ next 

ceeds to the next step 110. 20 sl6p m In step ^2, a user decides whether the watermark 

In the next step 110, one or more Karhunen-Loeve trans- is 'o be embedded in either the eigenvector domain A, or the 

forms (KLT) are applied to the image blocks of one or more coefficients of vectors Y, y . Preferably, the user selects either 

selected clusters. These KLT transforms are each derived ^ eigenvector domain A < or the coefficients of vectors Y v 

from and applied to a corresponding selected cluster. It is „ for the entire image, viz for all clusters However in another 

noted that, up until today, the statistically optimum, signal- 25 •mbodunent, the user is able to select the eigenvector 

* , ' , irj-m • U v i. u * *• i domain A, for one cluster and the coemcients of vectors Y. 7 

dependent transform, KLT is still believed to be impractical . 4 . , t ™- M i 1. • i_ Cl ■ iL ./ ; 

„ r . . ™ ■ . . , iL A . for another cluster. This will result in benefits in the security 

for image processing. This is due to the time-consuming of ^ watermarki method In a stm ^nter embodiment, 

computaUons needed for determining the data covariance ±c mcthod automatically and exclusively embeds the water- 

matnx (related to eigen-vectors). However m the preferred 30 mark in the eigenvector domain A,. Namely, the selection is 

method, this will not be a crucial problem any more. Firstly, automatic and no input from a user is required. Similarly, the 

the KLT adopted in the preferred method is the discrete KLT me thod can automatically and exclusively embed the water- 

(also called the Principle Components Analysis) where there raark in ^ coefficients of vectors Y 0 , In still further 

have been some fast implementations developed recently. embodiment, the actual selection process is dependent on 

Secondly, unlike image compression or image coding, for 35 the requirements of the particular application. After step 112, 

watermarking there is no need to transform all blocks or the method continues processing at step 114. 

segmented regions in the images. The fast clustering pro- In step 114, the method embeds the watermark in the 

cessing associated with the cluster selection step 106 allows selected domain, namely either the eigenvector domain A, or 

the reduction of the computational burden to an acceptable the coefficients of vectors Y, y . In the event the preferred 

and practical level. Namely, the KLT transforms need not be 40 method embeds the noise-like watermark into the coefficient 

applied over all the image, but only to the selected clusters. domain, the following embedding process is performed, A 

property of the coefficients of the vectors Y t> are that they arc 

In the step 110, a KLT transform is separately derived and completely uncorrected, as can be seen from eqn (6). 
applied for each cluster. Firstly, each non-overlapping block 

in the i th cluster (segment), i=l, A, N, is mapped to a 45 
d-dimensional vector X ip where d-3n 2 , by sequentially 



scanning each location in the block and taking its corre- E[YijYlj} = 
sponding tricomponent colour signals. (Note: for mono- 
chrome image, d-n 2 ). Here N denotes the total number of 
clusters to be transformed. Thus each block in the same 50 

cluster can be implicitly modelled as separate multivariate where X.-^X^A^X^ and are the eigenvalues of the cova- 
Gaussian Markov random fields. The sets of vectors X,-, nance matrix R,-, The preferred method embeds the water- 
created in this way are assumed to have jointly zero-mean mark in the first L ( - coefficients of each vector Y, y where 
Gaussion distributions. The dxd covariance matrix R, of 

each such stationary zero-mean Gaussion source, A, N, 55 L >** T % ™{^i\*s/>, (7) 

is estimated as The p arame t er in (7) represents the allowed distortion 

within the cluster. Its value will be defined for each cluster 

(1) separately and decided by the results of HVS analysis. Thus 

60 during this embedding process the vectors Y if are changed to 

In the event the preferred method embeds the noise-like 
Where M,- corresponds to the number of blocks in the ith watermark into the eigenvector domain, the watermark will 
cluster. The preferred method then calculates Eigenvalues of be embedded into the first L> eigenvectors of A,- in accor- 
the covariance matrix R, in accordance with 65 dance with eqn (7). Thus during this embedding process the 

transform A,- is changed to A,-. As the eigenvectors of the 
R t <ik"K^ik ( 2 ) transform matrix are orthogonal to each other, the generated 



ku 0 A 0 

0 A,2 A 0 

M M M M 

0 0 A A (Xl 



(6) 



1 ^ 
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watermark W, should be orthogonalized with respect to the inverse transforming the watermarked image data to derive 

eigenvectors before embedding. the original data, since this involves the use of a different 

In another embodiment, the transform A, may be first inverse transform. That is, because the watermarked data is 

inverted and then embedded with the watermark. different from the original data. Likewise, attempts to 

All the parameters of the selected domain are embedded, S fraudulently claim ownership on image data already water- 
by modulating the parameters by a noise-like watermark. marked by the preferred method will be defeated because a 
This modulation is achieved in the following way different optimal transform dependent upon the water- 
marked image data will be involved. Still further, the KLT 
P°f(P,PN()V)) (8) transform presents an extra choice to select the embedding 

10 locations either in the eigen-vector domain (basis function of 
Where f is a function of watermarking modulation, P and P jqj trans f orm ) or j n me coefficient domain of KLT trans- 
are parameters after and before watermarking, and PN(W) is form ^ means ^ watermarking based on KLT can be 
generated noise-like watermark. doQe in a much secure and flexible way than other methods. 

The content of image itself, the owner's private key of an In additioDj the KLT transform can provide a more effective 

encryption algorithm, embedding time or other information 15 ener gy-compact ability more than any other transform such 

related to the owner or the buyer can be used to form the as DCr DSJ FFT> etc . M there & significant redundant 

seeds of the embedded watermarks. Furthermore error cor- information contained in an image, applying a KLT trans- 

rection encoding can be used to increase the robustness of form l0 an image means that there is more space for 

the preferred method. The preferred method can use any one embedding the watermark. Also, unlike most of common 

of a number of typical methods to embed a watermark M watermarking schemes which only embed the watermark 

(modulation). A simple example of such a embedding into thc luminance channel, the KLT transform can directly 

method is as follows & jointly process colour images. It presents a flexible way 

_ to embed a watermark directly into all colour channels. In 

PrPt+a-fi » addition, the embedded messages will persist through image 

After the completion of the watermark embedding step 25 modifications such as scaling, rotating, printing-rescanning, 

114, the process continues at step 116. In step 116, the colour & intensity variation. 

respective inverse KLT transforms are separately applied to Turning now to FIG. 2 there is shown a copyright pro- 

their respective clusters. Where the watermark has been lection system for protecting an owner's watermarked image 

embedded in the eigenvector domain, the "embedded" in accordance with a preferred embodiment. Firstly, the 

inverse KLT transform is applied to the vectors. Thus the 30 owner of the image 200 sends his request 201 to a Copyright 

watermarked image blocks are transformed by Management Centre (CMC) 202 for registration. The CMC 

202 provides the owner of the image 200 with a watermark 

XifAriYyj-ifrMi (io) embedding tool 203 to embed his private watermark in his 

images 205. During this procedure, a reference file 206 is 

Where the watermark has been embedded in the coeffi- 35 generated sent to CMC 202. The reference file 206 is 

cients of the vectors, the inverse KLT is applied to the based on a analysis 2 07 of the owner's image 205. 

embedded vectors. Thus the watermark image blocks are Aftef wate rmarking 204, the CMC 202 will activate an 

transformed by Internet Spider 208 to protect the owner's watermarked 

% . -^x t M (li) images 210. Of course, there are so many variant applica- 

tr*t tl J a » / 4Q lions related to copyright protection, content authentication 

These resultant image blocks form the basis of the water- and content annotation. Preferably, the watermarking engine 

marked image. To retrieve the watermark from the water- is that described with reference to FIG. 1, namely the 

mark image or to authenticate the watermark image a watermarking engine is based on KLT transforms. This 

reference file is needed. This reference file may be the watermarking engine can be constructed as a kernel and 

original image itself or data based on the original image. 45 integrated into various copyright protection systems either 

Such data can include the size of the image, the resolution, for public use or for private use. 

the clusters selected and their associated KLT transform, Turning now to FIG. 3, there is shown a flow diagram of 

modulation technique and owner information. a method of generating a reference file that can be used for 

Consequently, after the original image is preprocessed in both image registration and for image authentication. This 

step 104, the preferred method stores 122 the original image 50 method of generating a reference file may be used in the 

or the derived data as the reference file. In step 122, the method of watermarking an image as shown in FIG. 1. The 

reference file is normally held in a secure location and method commences at step 300 and continues at steps 302 

maybe encrypted. and 304 where an image is input and preprocessed. In the 

After completion of inverse transform KLT 116, the next step 306, the method summarises and extracts some key 

preferred method continues at step 118, where the water- 55 points of the preprocessed image. These key points must be 

marked image is output. The method terminates at step 118. invariant to some typical modifications such as affine 

The use of the KLT transform as the watermark embed- distortions, colour or intensity changes etc. Alternatively, 
ding domain has the following advantages. Firstly, the KLT some variations of the key points can be allowed by adopting 
transform is a kind of signal-dependant transform. That a global afBne matching algorithm in the registration pro- 
means the watermark to be embedded will follow any 60 cedure. Then the invariant attributes are calculated 308. 
changes of image content. Even if the watermark is the same These attributes are associated with other relative informa- 
for all different images, the real form of the embedded tion such as maximum and minimum colour values, clusters 
watermark is different. Thus in this sense, the embedded and the number of clusters, and KLT transform matrices etc. 
digital watermark is dependent upon the image content and Finally this associated information is encrypted by some 
can be used to authenticate an image. Furthermore, whilst 65 cryptography algorithms 310 to form the reference file 312. 
the type of transform used to generate the image may be The method terminates at step 314. In this way, the water- 
known, the original watermark cannot be defeated by marked image is registered with reference to the properties 
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of the original image, which can be used in the method of normalisation method can be that which is described in J. 
extracting the watermark from the watermarked image. Fhisser, "An adaptive method for image registration", Pat- 
Alternatively, the reference file can be used for proving tem Recognition, Vol 25, No. l,pp45-54, 1992. The method 
whether and by how much the watermarked image has been normalises the tested image by extracting the key content 
tampered with. 5 from the tested image, measuring the modified parameters of 
Turning now to FIG. 4, there is shown of a watermark me tcsted with re f er ence to the reference file and then 
extracting method in accordance with a preferred embodi- normalising the tested image with respect to these modified 
ment. The method commences at step 400, where any parameters 

necessary parameters are initialised. In the next step 402, a The ^ mvenlion ^ for use in a number of 

watermarked image is input by a user for watermark extrac- ^ and ^ . applicat ions, such as the copy- 

Uon. Afterwards in step 404, the user then inputs a reference . , 4 t 4 . ; J * \ r . , ' . y 

file 403 of the original image and/or associated parameters nght protection system as pre viously described. Tta ; system 

of the type as previously described. The watermarked image can P r0Vld f f a PP roach to . ™bscqucnt use of digital 

is then normalised 406 based on the parameters retrieved una f s and P res f 1 e ^ dence for «>Py"ght protection, 

from the reference file 403. This normalised image is or alternatively pro v,de a display warning users, 

partitioned into blocks 106 and then clustered 108, in a 15 The present invention also can be used for content authen- 

similar manner as the watermarking procedure as described tication. In this application, after summarising the image, the 

with reference to FIG. 1. In step 108, any parameters extracted key description about the image can be encrypted 

necessary for the selection of the clusters are retrieved from by the owner's private key. The buyer can then verify the 

the reference file 403. After step 108, the method continues authenticity of the image by using a public key. Based on the 

with step 408 where the relevant domain is selected from 20 rule-based image registration method, the results of the 

data from the reference file. In the case where the domain authentication include the information about not only 

selected is the coefficient domain, the next step 410 applies whether the given image is altered or not, how much it is 

the transform A, to selected image blocks X, of the test altc ; rcd ' but f 50 wt | ich ^nd of modification the said image 

. ... «- • . * A v> \. . undergoes. The application may also inform the owner of the 

image to obtain the coefficients of vectors Y, y . The images 2$ ^ * ^ { ^ haye u$ed Qn his of hers 

blocks X, y of the test image are decided by the reference file images. A digital signature may also be embedded into the 

or owner's private key. The transform A, is also obtained for verifying tne authenticity of the content provider, 

from the reference file. Finally, a correlation 412 is under- In addition, the present invention also can be used for 

taken between the last mentioned coefficients of vectors Y (> content annotation. It is believed that the annotation done by 

and the coefficients of vectors Y tf obtained from the refer- 30 watermarking will be helpful for multimedia database based 

ence file and the watermark is extracted. The extracted on the current technologies. 

watermark is then compared with the watermark obtained The present invention is also particularly suitable for 
from the reference file. In the case where the domain watermarking the images that has been stored in the multi- 
selected is the transform domain, the step 410 applies the media database no matter what kind of applications it is used 
embedded transform A ( to selected image blocks X ty of the 35 for (copyright protection, authentication and annotation). As 
test image to obtain the coefficients Y (> . A correlation 412 is in this case, the image will belong to some classes or 
then undertaken between the last mentioned coefficients of categories. For example, a face database in the police 
vectors Y, 7 and the coefficients of vectors Y, y obtained from station, thus a optimal basis matrix of KLT can be obtained 
the reference file so as to check whether there exists a based on the whole images from a class. The images are then 
watermark. If the coefficients are the same then the water- 40 embedded in a similar manner as described with reference to 
mark is the same as was originally embedded. The extracted FIG. 1. In this way, it is very difficult for the users or the 
watermark is then output in step 418 and the method then attackers to compute out the exact basis matrix. Without the 
terminates. exact basis matrix, it is unlikely to decode or to remove the 

Turning now to FIG. 5 there is shown a flow diagram of embedded watermark, 
a method of registering and recovering an image for use in 45 Furthermore, the present invention can be used in relation 
the extraction method shown in FIG. 4. As a watermarked to other media such as video and audio. For instance, in a 
image may undergo some modifications during it's lifetime, video file, there is a strong relationship between consecutive 
an operation like image registration is used to estimate the frames. A technique called key frame extraction has been 
modification parameters of the watermarked image. The shown to be an effective approach to video indexing or 
method commences at step 500 and continues at step 502 50 summarising. By applying the KLT to hide the information 
where a watermarked image is input. The watermarked directly into video file, the optimal basis matrix of the KLT 
image is then preprocessed 504 and summarised 506 to can be computed out not only based the clustered blocks 
obtain some key features or points. Once these key points within each frame but also based on frames represented by 
are optimally selected, their invariant feature attributes are the same key frame. Based on KLT, the data hiding can be 
computed. Meanwhile relative parameters are obtained from 55 implemented in a more secure and flexible way. 
the reference file 508 by an information recovering proce- „ j « r j^i-j* */\ 
dure such as decryption. Such a reference file may be Second Preferred Embodunen^s) 
obtained by a method as described with reference to FIG. 3. FIG. 6 is a flow diagram of a method of embedding a 
In the next step, a rule-based global optimal search 510 is watermark in a digital image according to a preferred 
undertaken between the obtained invariant feature attributes 60 embodiment. The method commences at step 100 and any 
of the watermarked image and reference file. For example, necessary initialisation processes are undertaken. In the next 
if some feature points within a neighbour are missed, then a step 102, an original digital image is input by a user for 
chopping operation may be applied onto the watermarked processing. The original digital image is a pixel-map rep- 
image. The matching is mainly based on their invariant resentation which includes a numerical representation of the 
moments of the detected feature points. Based on the esti- 65 particular colour for each pixel location in a rectangular 
mated parameters, the watermarked image is the normalised array. Any numerical representation of colour can be used 
512 to recover an image similar to the original image. The and can be expressed as a sequence of one or more numbers. 
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Also, other information may be input at this stage, such as 
header information. Such header information can include the 
size of the image, resolution etc. Steps 102 to 108 of this 
method are the same as those described with reference to 
steps 102 to 108 of FIG. 1 and will not be described further. 

In step 602 of the method, the image blocks of each 
cluster i are averaged. These averaged blocks are each then 
embedded 604 with a watermark. An average (mean) block 
for M,- image blocks B, y (j«l,2, . . . M) that belong to cluster 
i is determined by 



10 



and a difference block is obtained by 



(12) 



15 



(13) 



The average block can be used to embed the watermark if 
it satisfies the HVS condition. If there are more than one 
suitable clusters then the user can select the cluster used for 
embedding. The averaging and embedding process is 
described in more detail below with reference to the fol- 
lowing alternative embodiments. 

In the first embodiment, the embedding is achieved by an 
orthogonalization process. Firstly, the average mean block 
B, is aligned as a (nxn)xl vector. This averaged mean block 
B ( - is saved to a reference file for subsequent watermark 
extraction. The initial watermark W f then is orthogonalized 
with respect to IT, to obtain the final watermark in 
accordance with the following: 



(14) 



where "B, is the unit vector along B,. _ 
Next, a smaller scaled version of W is added back to B ( - to 
obtain a watermarked average block B, in accordance with 
the following: 

B/»5f«Wj, where c is a small constant to control the strength of 
the watermark. (15) 

Finally in step 606, all the image blocks of the cluster are 
replaced with the watermarked average block B ( - to recon- 
struct a new image (watermarked image). The cluster criteria 
is chosen (108) so that the distortion caused by replacing all 
the image blocks within the cluster with the watermarked 
average block would be invisible to the human eye. 

In the second embodiment, the embedding is achieved by 
a spread spectrum process. In this embodiment, the average 
mean block B J - is first aligned as a (nxn)xl vector. The initial 
watermark W, is shaped to the same nxn length and with 
gaussian distribution (zero mean value). A small scaled 
version of W y is added back to B,- to obtain a watermarked 
average block B, in accordance with the following: 

BfiBfCl+cWf), where c is a small constant to control the strength 
of the watermark. (16) 

Finally in step 606, all the image blocks of the cluster are 
replaced with the watermarked average block B, to recon- 
struct a new image (watermarked image). The cluster criteria 
is chosen (108) so that the distortion caused by replacing all 
the image blocks within the cluster with the watermarked 
average block would be invisible to the human eye. 

After the completion of step 606, the watermarked image 
is outpoured and the process terminates at step 610. 



25 
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Turning now to FIG. 7, there is shown a watermark 
extracting method for extracting a watermark embedded in 
accordance with the method of FIG. 6. The method com- 
mences at step 700, where any necessary parameters are 
initialised. The test image is then input 102, preprocessed 
104 and block and clustered 106 in a similar manner as that 
of the embedding method of FIG. 6. After completion of step 
106, one or more clusters are selected for processing. The 
clusters selected are determined from information stored in 
the reference file 714. These clusters correspond to those 
selected in the embedding method. In the next step 706, the 
average mean block B ( is obtained from the reference file. In 
this step, the watermark W,- is also generated by the owner's 
key. The average mean block B, (from the reference file) is 
then aligned as a (nxn)xl vector. The watermark W, is then 
orthogonalised with respect to B, to obtain the original 
watermark in accordance with the following: 



20 



W^WriWrB^Bf where 
'Bi is the unit vector along 



(17) 



Similarly in the next step 708, a watermarked mean block J, 
is then obtained from the test image. In the event, the 
watermark has been embedded by the orthogonal process, 
then watermarked mean block J ( - is orthogonalised with 
respect to B, to obtain another vector X,. Finally in step 710, 
a correlation is undertaken between W ( . and X, to check 
whether the watermark exists. In the event, the watermark 
has been embedded by the spread spectrum process, then the 
DC component of J, is removed. In this case a correlation is 
undertaken between W ( . and J ( to check whether the water- 
mark exists. After the correlation is completed the method 
terminates at step 712. 

In a still further embodiment, the method of embedding 
and extraction of the second preferred embodiment may 
include a method of registering and recovering an image as 
shown in FIGS. 3 and 5. In this way, modifications that may 
subsequently occur to the embedded image are compensated 
by normalisation. In a still further embodiment, the first and 
40 second preferred embodiments may form part of the same 
watermarking engine. In the latter embodiment, a user's key 
is used to select the watermarking method to be used on a 
particular image. The user's key is an encrypted random key, 
which is divided into three parts. The first part is used to 
45 select the watermarking embedding space (mean block, the 
transform or vector coefficients), the second is used to select 
the watermark extraction method (eg. de -orthogonalization 
or correlation) and the third part is used as the seed to 
generate the initial watermark W ( -. In addition, the user's key 
can be used to select the cluster from the one or more 
clusters that meet the HVS criteria. 



Preferred Embodiment of Apparatus(s) 

The methods of FIGS. 1, 3, 4, 5, 6 and 7 is preferably 
55 practiced using a conventional general-purpose computer, 
such as the one shown in FIG. 8 wherein the processes of 
FIGS. 1, 3, 4, 5, 6 and 7 may be implemented as software 
executing on the computer. In particular, the steps of meth- 
ods of embedding and extracting a watermark are effected by 
60 instructions in the software that are carried out by the 
computer. The software may be divided into two separate 
parts; one part for carrying out the extraction and embedding 
methods; and another part to manage the user interface 
between the latter and the user. The software may be stored 
65 in a computer readable medium, including the storage 
devices described below, for example. The software is 
loaded into the computer from the computer readable 
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medium, and iben executed by the computer. A computer device, a computer readable card such as a PCMCIA card, 
readable medium having such software or computer pro- and the Internet and Intranets including email transmissions 
gram recorded on it is a computer program product. The use and information recorded on websites and the like. The 
of the computer program product in the computer preferably foregoing are merely exemplary of relevant computer read- 
effects an advantageous apparatus for extracting and embed- 5 a bl e mediums. Other computer readable mediums may be 
ding a watermark in accordance with the embodiments of practiced without departing from the scope and spirit of the 
the invention. invention. 

The computer system 800 consists of toe computer 802, ^ for m om describes f ^ numbef of embodi . 

a .video display 816, and 1 input devices 818, 820. In addition, meQls of ^ m invention however modifications 

the computer system 800 can have any of a number of other '0 ^ ^ ^ be ^ a ^ 

output devices including line printers, laser printers, plotters, ^ M withow d nin hom lhe and jrit of lhe 

and other reproduction devices connected to the computer mventioD For exa ^ j si , dependen t transforms other 

802. The computer system 800 can be connected to one or ^ ^ , ransforms ma used fa the eferred melhods . 

more other computers via a communication interface 8086 ^ t embodimcn(s a th6re f 0 re, to be considered in 

using an appropriate commumcauon channel 830 such as a 15 ^ ^ ^ be illustralive and nQt restrjctive 

modem communications path, a computer network, or the . 

like. The computer network may include a local area net- 7™ 18 ^aimed is: . . . 

work (LAN), a wide area network (WAN), an Intranet, \ A mc of Redding ;dig!Ul information in digi^ 

and/or the Internet multimedia data, wherein said method includes the follow- 
on ing steps: 

The computer 802 itself consists of a central processing 

unit(s) (simply referred to as a processor hereinafter) 804, a generating one or more transforms from the digital mul- 

memory 806 which may include random access memory timedia data or a portion of the digital multimedia data, 

(RAM) and read-only memory (ROM), input/output (10) wherein said transforms are dependent on the digital 

interfaces 808a, 808/? & 808c, a video interface 810, and one multimedia data or the portion of the digital multimedia 

or more storage devices generally represented by a block 25 data; 

812 in FIG. 8. The storage device(s) 812 can consist of one generating transformed digital multimedia data by appty- 

or more of the following: a floppy disc, a hard disc drive, a ing the one or more transforms to the digital multime- 

magne to-optical disc drive, CD-ROM, magnetic tape or any dia data or the portion of the digital multimedia data; 

other of a number of non-volatile storage devices well embedding the digital information in the transformed 

known to those skilled in the art. Each of the components digital multimedia data; and 

804 to 812 is typically connected to one or more of the other generating the digital multimedia data embedded with the 

devicesviaabusSWthatinturncanconsistofdata.address, ^ M information by applying one or more invcrsc 

and control buses. transforms of the one or more transforms to the embed- 

The video interface 810 is connected to the video display 35 dcd transformed digital multimedia data; 
816 and provides video signals from the computer 802 for wherein sakJ digital multimedia data is ^ imagc and said 
display on the video display 816. User input to operate the Qne Qr mofe transforms are Karhunen-Loeve trans- 
computer 802 can be provided by one or more input devices forms and safd digM information is embedded in the 
8086. For example, an operator can use the keyboard 818 firgt L coefficienls of the transformed digital multime- 
and/or a pointing device such as the mouse 820 to provide 4Q dia daU> where the number ^ fc determined in accor . 
input to the computer 802. dance ^ HVS analysis 

The system 800 is simply provided for illustrative pur- 2. A method as claimed in claim 1, wherein the method 

poses and other configurations can be employed without further comprises the following steps for selecting said 

departing from the scope and spirit of the invention. Exem- portion of said digital multimedia data: 

plary computers on which the embodiment can be practiced 45 partilionirlg lhe iraage int0 blocks; 

include IBM-PC/ATs or compatibles, one of the Macintosh clustering the partitioned blocks into classes according 

(TM) family of PCs, Sun Spallation (TM), or the like. Tlie lQ a h ^ mog ; neity criteria; and 

foregoing are merely exemplary of the types of computers t . C4l _ t 4 - ., 

with which the embodiments of the invention may be selecUng one or more of toe clusters as sard portion of said 

practiced. Typically, the processes of the embodiment, so dl 8 ,lal mulUmedia da,a m Wlth HVS 

described hereinafter, are resident as software or a program . < , • , • , . L • 4L i 

recorded on a hard disk drive (generally depicted as block , 3 A ™> thod . " claimed id claim 2, wherein the selecting 

812 in FIG. 8) as the computer readable medium, and read ste P, ls determined m accordance with HVS analysis and a 

and controlled using the processor 804. Intermediate storage user s sc ec on. 

of the program and pixel data and any data fetched from the 55 ■ ?' A T &S c ^ in claim X > wherem said dl S ltal 

network may be accomplished using the semiconductor ^formation is a watermark. 

on/ k 1 • *u~ u nr A A-^v 5. A method as claimed in claim 1, wherein said method 

memory 806, possibly in concert with the hard disk drive . . . , , iL * « 

further includes the following step: 

In some instances, the program may be supplied to the storing the digital multimedia data as a reference file 

user encoded on a CD-ROM or a floppy disk (both generally 60 < r J 1 * f 50 ^* d ^rrn^ou. 

depicted by block 812 ), or alternatively could be read by the fi * me *° d a f k cla f imed m claUD *" Wherem S3ld mCth ° d 

user from the network via a modem device connected to the fartte mcludcs the followin S stc P s 

computer, for example. Still further, the software can also be extracting invariant representations of the image; 

loaded into the computer system 800 from other computer storing said extracted representations together with asso- 

readable medium including magnetic tape, a ROM or inte- 65 ciated information in a reference file, 

grated circuit, a magneto-optical disk, a radio or infra-red 7. A method as claimed in claim 1, wherein said method 

transmission channel between the computer and another further includes the following steps 
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extracting key features from said image; and 
storing the key features together with associated informa- 
tion. 

8. A method as claimed in claim 7, wherein said key 
features include: the positions of the key features, invariant 5 
attributes of the key features, maximum and minimum 
colour values of the image, the size of the image. 

9. A method as claimed in claim 1, wherein said digital 
information is a copyright notice. 

10. A method as claimed in claim 1, wherein said digital 10 
information is an annotation of said digital multimedia data. 

11. A method as claimed in claim 1, wherein said digital 
information is authentication information verifying said 
digital multimedia data. 

12. A method of embedding digital information in digital 15 
multimedia data, wherein said method includes the follow- 
ing steps: 

generating one or more transforms from the digital mul- 
timedia data or a portion of the digital multimedia data, 
wherein said transforms are dependent on the digital 20 
multimedia data or the portion of the digital multimedia 
data; 

generating transformed digital multimedia data by apply- 
ing the one or more transforms to the digital multime- 
dia data or the portion of the digital multimedia data; 25 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the digital multimedia data embedded with the 
digital information by applying one or more embedded 3Q 
inverse transforms to the transformed digital multime- 
dia data. 

13. A method as claimed in claim 12, wherein said digital 
multimedia data is an image. 

14. A method as claimed in claim 12, wherein the method 
further comprises the following steps for selecting said 
portion of said digital multimedia data: partitioning the 
image into blocks; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; and 4Q 

selecting one or more of the clusters as said portion of said 
digital multimedia data in accordance with HVS analy- 
sis. 

15. A method as claimed in claim 14, wherein the select- 
ing step is determined in accordance with HVS analysis and 45 
a user's selection. 

16. A method as claimed in claim 12, wherein said 
transform is a Karhunen-Loeve transform. 

17. A method as claimed in claim 12, wherein said digital 
multimedia data is an image and said one or more transforms 50 
are Karhunen-Loeve transforms and said digital information 

is embedded in the first L^eigenvectors of the Karhunen- 
Loeve transforms, where the number L,. is determined in 
accordance with HVS analysis, 

18. A method as claimed in claim 12, wherein said digital 55 
information is a watermark. 

19. A method as claimed in claim 12, wherein said method 
further includes the following step: 

storing the digital multimedia data as a reference file 
together with associated information. 6Q 

20. A method as claimed in claim 13, wherein said method 
further includes the following steps 

extracting invariant representations of the image; 
storing said extracted representations together with asso- 
ciated information in a reference file. 65 

21. A method as claimed in claim 13, wherein said method 
further includes the following steps 
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extracting key features from said image; and 
storing the key features together with associated informa- 
tion. 

22. A method as claimed in claim 21, wherein said key 
features include: the positions of the key features, invariant 
attributes of the key features, colour values of the key 
features, maximum and minimum colour values of the 
image, the size of the image. 

23. A method as claimed in claim 12, wherein said digital 
information is a copyright notice. 

24. A method as claimed in claim 12, wherein said digital 
information is an annotation of said digital multimedia data. 

25. A method as claimed in claim 12, wherein said digital 
information is authentication information verifying said 
digital multimedia data. 

26. Amethod of embedding digital information in a digital 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; 

selecting one or more of the clusters in accordance with 
HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, wherein the image 
blocks of each selected cluster are used as a vector 
population for the purposes of generating the associated 
K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

embedding, for each selected cluster, the digital informa- 
tion in the associated K-L transform; and 

applying, for each selected cluster, an inverse transform of 
the embedded associated K-L transform to the trans- 
formed image blocks of the selected cluster. 

27. Amethod as claimed in claim 26, wherein said digital 
information is embedded in the first L, eigenvectors of the 
Karhunen-Loeve transforms, where the number L ( is deter- 
mined in accordance with HVS analysis. 

28. Amethod as claimed in claim 26, wherein said digital 
information is a noise-like watermark. 

29. Amethod as claimed in claim 26, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

30. Amethod of embedding digital information in a digital 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; 

selecting one or more of the clusters in accordance with 
HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, 

wherein the image blocks of each selected cluster are used 
as a vector population for the purposes of generating 
the associated K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

embedding, for each selected cluster, the digital informa- 
tion in the selected transformed image blocks; and 

applying, for each selected cluster, an inverse transform of 
the associated K-L transform to the embedded trans- 
form image blocks of the selected cluster 



04/28/2004, EAST Version: 1.4.1 



US 6,678,389 Bl 



19 



20 



20 



25 



31. A method as claimed in claim 30, wherein said digital 
information is embedded in the first L ( - coefficients of the 
transformed image blocks, where the number L { is deter- 
mined in accordance with HVS analysis. 

32. A method as claimed in claim 30, wherein said digital S 
information is a noise -like watermark. 

33. A method as claimed in claim 30, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

34. A method of embedding digital information in a digital 10 
image, wherein said method includes the following steps: 

partitioning the image into blocks of pixels; 

clustering the partitioned blocks into classes according to 
a homogeneity criteria; 

selecting one or more of the clusters in accordance with 
HVS analysis; 

generating an associated Karhunen-Loeve (K-L) trans- 
form for each selected cluster, wherein the image 
blocks of each selected cluster are used as a vector 
population for the purposes of generating the associated 
K-L transform; 

applying the associated K-L transform to the image blocks 
of the selected cluster to produce corresponding trans- 
formed image blocks; 

selecting, for each selected cluster, either the associated 
K-L transform or its corresponding transformed image 
blocks for embedding; 

embedding, for each selected cluster, the digital informa- 
tion in the selected K-L transform or the selected 
transformed image blocks; 

applying, for those selected clusters in which the digital 
information has been embedded in the associated K-L 
transform, an inverse transform of the embedded asso- 
ciated K-L transform to the transformed image blocks 
of the selected cluster; and 

applying, for those selected clusters in which the digital 
information has been embedded in the transformed 
image blocks, an inverse transform of the associated 
K-L transform to the embedded transform image blocks 
of the selected cluster. 

35. A method as claimed in claim 34, wherein said digital 
information is embedded in the first L ( - eigenvectors of the 
Karhunen-Loeve transforms, where the number L ( . is deter- 
mined in accordance with HVS analysis. 

36. A method as claimed in claim 34, wherein said digital 
information is embedded in the first L>. coefficients of the 
transformed image blocks, where the number L, is deter- 
mined in accordance with HVS analysis. 

37. A method as claimed in claim 34, wherein said digital 
information is a noise -like watermark. 

38. A method as claimed in claim 34, wherein the select- 
ing step is determined in accordance with HVS analysis and 
a user's selection. 

39. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 

generating one or more transforms from the images of 60 
said respective one or more classes, wherein said 
transforms are dependent on the images; 

generating transformed images by applying the one or 
more transforms to the images of said respective one or 
more classes; 65 

embedding the digital information in the transformed 
images; and 
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generating the images data embedded with the digital 
information by applying one or more inverse trans- 
forms of the one or more transforms to the embedded 
transformed images; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L, coefficients of the transformed digital mul- 
timedia data, where the number L, is determined in 
accordance with HVS analysis. 

40. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 

generating one or more transforms from the images of 
said respective one or more classes, wherein said 
transforms are dependent on the images; 

generating transformed images by applying the one or 
more transforms to the images of said respective one or 
more classes; 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the images embedded with the digital infor- 
mation by applying one or more embedded inverse 
transforms to the transformed images. 

41. A method of embedding digital information into video 
images including a plurality of frames, wherein said method 
includes the following steps: 

extracting one or more key frames from the video images; 

generating one or more transforms from the key frames or 
a part thereof, wherein said transforms are dependent 
on the key frames or the part thereof; 

generating transformed key frames or part thereof by 
applying the one or more transforms to the key frames 
or the part thereof; 

embedding the digital information in the transformed key 
frames or part thereof; and 

generating the key frames or part thereof embedded with 
the digital information by applying one or more inverse 
transforms of the one or more transforms to the embed- 
ded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L, coefficients of the transformed digital mul- 
timedia data, where the number L t - is determined in 
accordance with HVS analysis. 

42. A method of embedding digital information into video 
images including a plurality of frames, wherein said method 
includes the following steps: 

extracting one or more key frames from the video images; 

generating one or more transforms from the key frames or 
a part thereof, wherein said transforms are dependent 
on the key frames or the part thereof; 

generating transformed key frames or part thereof by 
applying the one or more transforms to the key frames 
or the part thereof; 

embedding the digital information in the one or more 
transforms or their inverses; and 

generating the key frames or part thereof embedded with 
the digital information by applying one or more embed- 
ded inverse transforms to the transformed key frames 
or part thereof. 

43. A method of modifying a first image in accordance 
with an image signature, wherein the image signature 
includes encrypted key points of a second image and their 
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invariant attributes and other aligned global information of 
the second image and the method includes the steps of: 

decrypting the image signature to obtain the key points 
and their invariant attributes and other global informa- 
tion of the second image; 

extracting key points and their invariant attributes from 
the first image; extracting other global information 
from the first image; 

matching the key points and their invariant attributes and 
other global information of the first and second images; 
and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 
information. 

44. An apparatus for embedding digital information in 
digital multimedia data, wherein said apparatus includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the trans- 
formed digital multimedia data; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more inverse transforms of the one or more transforms 
to the embedded transformed digital multimedia data 

wherein said digital multimedia data is an image and said 
one or more transforms are Karhunen-Loeve trans- 
forms and said digital information is embedded in the 
first L ( coefficients of the transformed digital multime- 
dia data, where the number L t is determined in accor- 
dance with HVS analysis. 

45. An apparatus for embedding digital information in 
digital multimedia data, wherein said apparatus includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more embedded inverse transforms to the transformed 
digital multimedia data. 

46. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
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vector population for the purposes of generating the 
associated K-L transform; 
means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks. 

47. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for embedding, for each selected cluster, the digital 
information in the selected transformed image blocks; 
and 

means for applying, for each selected cluster, an inverse 
transform of the associated K-L transform to the 
embedded transform image blocks of the selected clus- 
ter. 

48. An apparatus for embedding digital information in a 
digital image, wherein said apparatus includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for selecting, for each selected cluster, either the 
associated K-L transform or its corresponding trans- 
formed image blocks for embedding; 

means for embedding, for each selected cluster, the digital 
information in the selected K-L transform or the 
selected transformed image blocks; 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
associated K-L transform, an inverse transform of the 
embedded associated K-L transform to the transformed 
image blocks of the selected cluster; and 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
transformed image blocks, an inverse transform of the 
associated K-L transform to the embedded transform 
image blocks of the selected cluster. 

49. An apparatus for embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said apparatus 
includes: 

means for generating one or more transforms from the 
images of said respective one or more classes, wherein 
said transforms are dependent on the images; 
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means for generating transformed images by applying the 
one or more transforms to the images of said respective 
one or more classes; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the images embedded with the 
digital information by applying one or more embedded 
inverse transforms to the transformed images. 

50. An apparatus for embedding digital information into 
video images including a plurality of frames, wherein said 
apparatus includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the trans- 
formed key frames or part thereof; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more inverse transforms of the one or more trans- 
forms to the embedded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first coefficients of the transformed digital mul- 
timedia data, where the number L ( - is determined in 
accordance with HVS analysis. 

51. An apparatus for embedding digital information into 
video images including a plurality of frames, wherein said 
apparatus includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more embedded inverse transforms to the trans- 
formed key frames or part thereof. 

52. An apparatus for modifying a first image in accor- 
dance with an image signature, wherein the image signature 
includes encrypted key points of a second image and their 
invariant attributes and other aligned global information of 
the second image and the apparatus includes: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 

attributes and other global information of the first and 

second images; and 
means for normalising the first image based on said 

matched key points and their invariant attributes and 

other global information. 



53. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in digital multime- 
dia data, wherein said computer program product includes: 

s means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 

10 means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the trans- 
1S formed digital multimedia data; and 

means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more inverse transforms of the one or more transforms 
to the embedded transformed digital multimedia data; 
wherein said digital multimedia data is an image and said 
one or more transforms are Karhunen-Loeve trans- 
forms and said digital information is embedded in the 
first L ( . coefficients of the transformed digital multime- 
dia data, where the number L, is determined in accor- 
dance with HVS analysis. 

54. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in digital multime- 
dia data, wherein said computer program product includes: 

means for generating one or more transforms from the 
digital multimedia data or a portion of the digital 
multimedia data, wherein said transforms are depen- 
dent on the digital multimedia data or the portion of the 
digital multimedia data; 
means for generating transformed digital multimedia data 
by applying the one or more transforms to the digital 
multimedia data or the portion of the digital multimedia 
data; 

means for embedding the digital information in the one or 

more transforms or their inverses; and 
means for generating the digital multimedia data embed- 
ded with the digital information by applying one or 
more embedded inverse transforms to the transformed 
digital multimedia data. 

55. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; 
means for clustering the partitioned blocks into classes 

according to a homogeneity criteria; 
means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 
5S means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 
00 means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 
means for embedding, for each selected cluster, the digital 
information in the associated K-L transform; and 
65 means for applying, for each selected cluster, an inverse 
transform of the embedded associated K-L transform to 
the transformed image blocks of the selected cluster. 
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56. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for embedding, for each selected cluster, the digital 
information in the selected transformed image blocks; 
and 

means for applying, for each selected cluster, an inverse 
transform of the associated K-L transform to the 
embedded transform image blocks of the selected clus- 
ter. 

57. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a digital image, 
wherein said computer program product includes: 

means for partitioning the image into blocks of pixels; 

means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 

means for selecting one or more of the clusters in accor- 
dance with HVS analysis; 

means for generating an associated Karhunen-Loeve 
(K-L) transform for each selected cluster, wherein the 
image blocks of each selected cluster are used as a 
vector population for the purposes of generating the 
associated K-L transform; 

means for applying the associated K-L transform to the 
image blocks of the selected cluster to produce corre- 
sponding transformed image blocks; 

means for selecting, for each selected cluster, either the 
associated K-L transform or its corresponding trans- 
formed image blocks for embedding; 

means for embedding, for each selected cluster, the digital 
information in the selected K-L transform or the 
selected transformed image blocks; 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
associated K-L transform, an inverse transform of the 
embedded associated K-L transform to the transformed 
image blocks of the selected cluster; and 

means for applying, for those selected clusters in which 
the digital information has been embedded in the 
transformed image blocks, an inverse transform of the 
associated K-L transform to the embedded transform 
image blocks of the selected cluster. 

58. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information in a plurality of 
images, wherein the images are stored and classified into one 
or more classes and said computer program product 
includes: 

means for generating one or more transforms from the 
images of said respective one or more classes, wherein 
said transforms are dependent on the images; 
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means for generating transformed images by applying the 
one or more transforms to the images of said respective 
one or more classes; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the images embedded with the 
digital information by applying one or more embedded 
inverse transforms to the transformed images. 

59. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information into video images 
including a plurality of frames, wherein said computer 
program product includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the trans- 
formed key frames or part thereof; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more inverse transforms of the one or more trans- 
forms to the embedded key frames or part thereof; 

wherein said one or more transforms are Karhunen-Loeve 
transforms and said digital information is embedded in 
the first L, coefficients of the transformed digital mul- 
timedia data, where the number L, is determined in 
accordance with HVS analysis. 

60. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for embedding digital information into video images 
including a plurality of frames, wherein said computer 
program product includes: 

means for extracting one or more key frames from the 
video images; 

means for generating one or more transforms from the key 
frames or a part thereof, wherein said transforms are 
dependent on the key frames or the part thereof; 

means for generating transformed key frames or part 
thereof by applying the one or more transforms to the 
key frames or the part thereof; 

means for embedding the digital information in the one or 
more transforms or their inverses; and 

means for generating the key frames or part thereof 
embedded with the digital information by applying one 
or more embedded inverse transforms to the trans- 
formed key frames or part thereof. 

61. A computer program product including a computer 
readable medium having recorded thereon a computer pro- 
gram for modifying a first image in accordance with an 
image signature, wherein the image signature includes 
encrypted key points of a second image and their invariant 
attributes and other aligned global information of the second 
image and the computer program product includes: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 
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means for matching the key points and their invariant 
attributes and other global information of the first and 
second images; and 

means for normalizing the first image based on said 
matched key points and their invariant attributes and 

* other global information. 

62. A method as claimed in claim 34, further comprising 
registering the image including the following steps: 

extracting key points from the image and their invariant 
attributes; 

extracting other global information from the image; 
aligning the extracted key points and their invariant 

attributes with the global information; and 
encrypting the aligned information to provide an image 

signature. 

63. An apparatus as claimed in claim 48, further com- 
prising means for registering the image including: 

means for extricating key points from the image and their 

invariant attributes; 
means for extracting other global information from the 

image; 

means for aligning the extracted key points and their 
invariant attributes with the global information; 

means for encrypting the aligned information to provide 25 
an image signature. 

64. A computer program product as claimed in claim 56, 
in which the computer program registers the image and 
includes; 
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means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 
attributes and other global information from the first 
image; and 

means for normalising the first image based on said 
matched key points and their invariant attributes and 
other global information. 

67. A computer program product as claimed in claim 60, 
including: 

means for modifying the image in accordance with the 
image signature; wherein the image signature includes 
encrypted key points of a second image and their 
invariant attributes and other aligned global informa- 
tion of the second image, said means for modifying 
including: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 

means for extracting other global information from the 
first image; 

means for matching the key points and their invariant 
attributes and other global information of the first 
image based on said matched key points and their 
invariant attributes and other global information. 

68. A method as claimed in claim 12, further comprising: 
extracting digital information from first digital multimedia 



means for extracting key points from the image and their 30 data having embedded therein said digital information 
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invariant attributes; 
means for extracting other global information from the 
image; 

means for aligning the extracted key points and their 
invariant attributes with the global information; 

means for encrypting the aligned information to provide 
an image signature. 

65. A method as claimed in claim 39, further comprising 
modifying a first image in accordance with an image 
signature, wherein the image signature includes encrypted 
key points of a second image and their invariant attributes 
and other aligned global information of the second image, 
wherein said modifying the first image includes the steps of: 

decrypting the image signature to obtain the key points 
and their invariant attributes and other global informa- 
tion of the second image; 

extracting key points and their invariant attributes from 
the first image; 

extracting other global information from the first image; 

matching the key points and their invariant attributes and 
other global information of the first and second images; 
and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 55 
information, 

66. An apparatus as claimed in claim 49, further com- 
prising means for modifying a first image in accordance with 
an image signature, wherein the image signature includes 
encrypted key points of a second image and their invariant 
attributes and other aligned global information of the second 
image, said means for modifying including: 

means for decrypting the image signature to obtain the 
key points and their invariant attributes and other 
global information of the second image; 

means for extracting key points and their invariant 
attributes from the first image; 
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including the following steps: 
deriving one or more embedded transforms from a refer- 
ence file, wherein said embedded transforms are depen- 
dent on second digital multimedia data or a portion 
thereof; 

deriving transformed digital multimedia data from the 
reference file, wherein said transformed digital multi- 
media data is dependent on the second digital multi- 
media data or a portion thereof; 

generating transformed digital multimedia data by apply- 
ing one or more of the derived embedded transforms to 
the first digital multimedia data or a portion thereof; 
and 

correlating the generated transformed digital multimedia 
with the derived transformed digital multimedia to 
check whether the digital information embedded in the 
first multimedia data is the same as that derived from 
the reference file. 

69. A method as claimed in claim 12, further comprising 
extracting digital information from first digital multimedia 
data having embedded therein said digital information, 
including the following steps: 

deriving one or more transforms from a reference file, 
wherein said transforms are dependent on second digi- 
tal multimedia data or a portion thereof; 

deriving transformed digital multimedia data from the 
reference file, wherein said transformed digital multi- 
media data is dependent on the second digital multi- 
media data or a portion thereof; 

generating embedded transformed digital multimedia data 
by applying one or more of the derived embedded 
transforms to the first digital multimedia data or a 
portion thereof; and 

correlating the generated embedded transformed digital 
multimedia with the derived transformed digital mul- 
timedia so as to extract the digital information. 
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70. An apparatus as claimed in claim 49, further com- 
prising means for extracting digital information from first 
digital multimedia data having embedded therein said digital 
information, including: 

means for deriving one or more embedded transforms 5 
from a reference file, wherein said embedded trans- 
forms are dependent on second digital multimedia data 
or a portion thereof; 

means for deriving transformed digital multimedia data 
from the reference file, wherein said transformed digi- 
tal multimedia data is dependent on the second digital 
multimedia data or a portion thereof; 

means for generating transformed digital multimedia data 
by applying one or more of the derived embedded 15 
transforms to the first digital multimedia data or a 
portion thereof; and 

means for correlating the generated transformed digital 
multimedia with the derived transformed digital mul- 
timedia to check whether the digital information 2 o 
embedded in the first multimedia data is the same as 
that derived from the reference file. 

71. A computer program product as claimed in claim 60, 
including means extracting digital information from first 
digital multimedia data having embedded therein said digital 2 $ 
information, including: 

means for deriving one or more embedded transforms 
from a reference file, wherein said embedded trans- 
forms are dependent on second digital multimedia data 
or a portion thereof; 30 

means for deriving transformed digital multimedia data 
from the reference file, wherein said transformed digi- 
tal multimedia data is dependent on the second digital 
multimedia data or a portion thereof; 
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means for generating transformed digital multimedia data 
by applying one or more of the derived embedded 
transforms to the first digital multimedia data or a 
portion thereof; and 

means for correlating the generated transformed digital 4Q 
multimedia with the derived transformed digital mul- 
timedia to check whether the digital information 
embedded in the first multimedia data is the same as 
that derived from the reference file, having embedded 
therein said digital information, wherein said computer 45 
program product includes: 

means for partitioning the image into blocks of pixels; 
means for clustering the partitioned blocks into classes 
according to a homogeneity criteria; 



means for selecting one or more of the clusters in 
accordance with information obtained from a refer- 
ence file; 

means for retrieving, for each selected cluster, an 
average block of pixels stored in the reference file; 
means for averaging, for each selected cluster, the 

blocks of pixels of the image; and 
means for correlating, for each selected pixel, the 
averaged blocks of the image with the retrieved 
blocks to determine whether a watermark exists. 
72. A method of embedding digital information in a 
plurality of images, wherein the images are stored and 
classified into one or more classes and said method includes 
the following steps: 
generating one or more transforms from the images of 
said respective one or more classes, wherein said 
transforms are dependent on the images; generating 
transformed images by applying the one or more trans- 
forms to the images of said respective one or more 
classes; 

embedding the digital information in the transformed 
images; 

generating the images data embedded with the digital 
information by applying one or more inverse trans- 
forms of the one or more transforms to the embedded 
transformed images; and 
modifying a first image in accordance with an image 
signature, wherein the image signature includes 
encrypted key points of a second image and their 
invariant attributes and other aligned global informa- 
tion of the second image, wherein said modifying the 
first image includes the steps of: 
decrypting the image signature to obtain the key points 
and their invariant attributes and other global infor- 
mation of the second image; 
extracting key points and their invariant attributes from 
the first image; extracting other global information 
. from the first image; 

matching the key points and their invariant attributes 
and other global information of the first and second 
images; and 

normalising the first image based on said matched key 
points and their invariant attributes and other global 
information. 
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